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(S) Method and apparatus for performing dynamic texture mapping for complex surfaces. 

(57) A system and process is provided which en- 
ables the dynamic mapping of texture to a 
variety of primitives, including complex primi- 
tives such as NURBS. The object, located in 
modeling coordinate (MC) space is para- 
meterized to determine the parameter coordi- 
nate (PC) space associated with the object. This 
step is performed for an object and is readily 
applied to a variety of textures and views subse- 
quently readied. Once the parameterization pro- 
cess has been performed, a mapping between 
the PC space and texture coordinate (TC) space 
is generated. This mapping, referred to herein 
as the t mapping correlates the (s,t) coordi- 
nates of the PC space to the (u,v) coordinates of 
the TC space. The object is mapped from the 
MC space to the display coordinate (DC) and 
the t mapping is then used to map the texture 
map onto the selected points of the object, such 
as the vertices of the object. Parameter interpo- 
lation is then performed to render the pixels of 
the object in the display space. A color compo- 
sition process is executed to combine the col- 
ors of the texture map with the pixels of the 
object. Furthermore, in the preferred embodi- 
ment, the granularity of the texture applied to 
the object can be controlled using such techni- 
ques as mip-map criteria, texture quality or, in 
the case of NURBS, NURBS approximation 
criteria. 
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BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates to a system and 
method for rendering textured objects. Particularly, 
the present invention relates to a system and method 
for rendering textured NURBS surfaces. 

2. Art Background 

The ability to provide texturing to a surface en- 
hances rendering capabilities in computer graphics. 
In one technique, referred to as texture mapping, a 
map of the texture is generated in a texture coordin- 
ate (TC) space. The object to which the texture is to 
be applied is realized in modeling coordinate (MC) 
space. A binding processes is then performed to de- 
fine the correspondence of the texture coordinates to 
the object coordinates. Typically, the binding process 
binds the coordinates of the texture map in TC space 
(e.g., u,v coordinates) to predetermined coordinates 
of the object in MC space (e.g., x,y,z,w coordinates). 
A subset of all possible points of the object is typically 
used, such as the vertices of the object. 

Once the binding process is complete, the object 
is mapped to device coordinate space (DC). In order 
to determine the texture coordinate associated with 
each pixel of the object in DC space, an interpolation 
process, using the subset of all possible points bind- 
ed, is performed to determine the elements of the tex- 
ture map to be applied to each coordinate of the ob- 
ject in DC space. A color composition process is sub- 
sequently performed to incorporate the colors of the 
texture map onto the object in the display coordinate 
space. This object with the colors of the texture is 
then displayed on the display device. For further in- 
formation regarding texture and the texturing process 
see, Kamen, "Texture Mapping", Sun Interactive Me- 
dia, November 1992, and Kamen, "Texture Mapping, 
Part II: Parameterization", Sun Interactive Media, 
February 1993; or Rogers, Earnshaw, Editors, Com- 
puter Graphics Techniques, Theory and Practice , pp. 
159-187 (1990, Springer- Verlag). 

However, the binding process is performed for 
each object and texture combination and the applica- 
tion of different texture maps to the same object re- 
quires separate binding processes. Furthermore, for 
objects defined in parameter coordinate (PC) space, 
such as non-uniform rational B-spline surfaces 
(NURBS), the process works only if the PC space is 
set to equal the TC space or by first tessellating 
NURBS into triangles and applying known texture 
mapping processes for each triangle. 

SUMMARY OF THE INVENTION 

An innovative system and method for texturing 



objects is provided. In this process, the object located 
in modeling coordinate (MC) space, or, alternately, 
world coordinate (WC) space, undergoes a parame- 
terization process to determine parameter coordinate 

5 (PC) space associated with the object. This process 
is performed once for an object regardless of the 
number of different views or different textures which 
may be subsequently applied to the object. If the ob- 
ject is a NURBS, further time savings are achieved as 

10 the object is already realized in parameter space. 

Once the parameterization process has been 
performed, a mapping between the PC space and 
texture coordinate (TC) space is generated. This 
mapping, referred to herein as the x mapping, corre- 

15 lates the (s^-Sp) coordinates of the PC space to the 
(Ui.-.Un) coordinates of the TC space. The object is 
mapped from the MC space to the display coordinate 
(DC) and the t mapping is then used to map the tex- 
ture map onto the selected points of the object, such 

20 as the vertices of the object. In a preferred embodi- 
ment, object parameter interpolation is then per- 
formed to render the pixels of the object, including the 
location, colors and intensity of the pixel, in the DC 
space. A color composition process is executed to in- 

25 terpolate the colors of the mapped texture to render 
a texture color for each pixel and a composition proc- 
ess is performed to combine the texture colors with 
the pixels of the object. Other processes and se- 
quences for performing object parameter interpola- 

30 tion, texture mapping, texture interpolation and tex- 
ture/object composition can also be used. In addition, 
in the preferred embodiment, the granularity of the 
texture applied to the object can be controlled using 
such techniques as mipmap criteria, texture quality 

35 or, in the case of NURBS, NURBS approximation cri- 
teria. 

BRIEF DESCRIPTION OF THE DRAWINGS 

40 The objects, features and advantages of the 

present invention will be apparent from the following 
detailed description in which: 

Figure 1 is a conceptual block diagram illustrat- 
ing one embodiment of the present invention. 
45 Figure 2 is a conceptual diagram illustrating the 

process of the present invention. 

Figures 3a, 3b and 3c are flowcharts illustrating 
the process steps of the present invention. 

Figure 4 illustrates mappings between different 
50 coordinate spaces. 

Figure 5 illustrates visually the t mapping be- 
tween the parameter coordinate (PC) space and the 
texture coordinate (TC) space. 

Figures 6a - 6e illustrate exemplary interpolation 
55 techniques to generate texture on the object. 
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DETAILED DESCRIPTION OF THE INVENTION 

The method and apparatus of the present inven- 
tion performs the complex operation of applying tex- 
ture to objects, including complex objects such as 5 
NURBS, in a manner that minimizes computation of 
mapping functions between textures and objects 
while enabling the capability to control the quality or 
granularity of the texture rendered including the capa- 
bility to provide such graphical aspects as warping. 10 

The system of the present invention is conceptu- 
ally illustrated by the block diagram of Fig. 1. A CPU 
10, system memory 15, Input/Output (I/O) devices 20 
and a graphics subsystem 25 are coupled via a sys- 
tem bus 30. The CPU 10 functions as the central or 15 
host processor and typically executes application 
programs that generate the objects and apply texture 
maps to the objects which are displayed in accor- 
dance with the present invention. The CPU 10 func- 
tions as a powerful general purpose processor and 20 
utilizes the available resources such as the system 
memory 15, I/O devices 20 and other peripherals de- 
vices (not shown) to execute complex programs and 
processes. The CPU 1 0 may be configured into a sys- 
tem or workstation such as those manufactured by 25 
Sun Microsystems, Inc, Mountain View, California. 

The graphics subsystem is preferably configured 
to execute graphic specific, often repetitive, process- 
es to off-load the processing overhead from the CPU 
10. Although the graphics subsystem can be config- 30 
ured a number of ways, in one embodiment the sys- 
tem 25 includes a floating point processor, memory 
and VLSI, and is configured to execute simple, but 
costly and highly repetitive computations required as 
part of the process for rendering objects with texture. 35 
For example, at least a portion of the computations 
can be performed by special, dedicated hardware, 
such as special VLSI devices for the rendering of tri- 
angles representative of the object, in order to further 
increase the speed of performing the processes. For 40 
example, a floating point processor may tessellate 
the object to triangles and apply the texture to the tri- 
angles. The VLSI component then translates the tri- 
angles into pixel data for storage in the frame buffer 
40. The pixel data is stored in the frame buffer 40 in 45 
a sequence readily identified with the x-y coordinate 
space of the display device 50. 

The display controller45 generates the display of 
the object defined by the pixel data located in the 
frame buffer. The display controller 45 through its 50 
controller 55 cycles through the frame buffer, one 
scan line at a time in accordance with the raster scan 
rate, for example, 60 times a second. Memory ad- 
dresses are generated by the controller 55 to access 
the pixel data. The pixel data is read from the frame 55 
buffer in sequence and input to the display controller 
color look-up table (LUT) 60. The LUT 60 contains the 
digital control signals used to control the intensity and 



color of the output, for example beams of electrons, 
on the display device 50. The signals output by the 
LUT 60 are input to digital to analog converters 
(DACs) 65, 70 and 75 which generate the analog sig- 
nals to control the energizing or generation of the lo- 
cation an intensity respectively of the red, green and 
blue components of the pixel to be displayed. The dis- 
play device may be a raster scan device such as a 
cathode ray tube (CRT). For purposes of explanation 
the display device will be a CRT; however, it is obvious 
to one skilled in the art that other display devices may 
be utilized in accordance with the system of the pres- 
ent invention. 

If the device is a cathode ray tube, the analog 
control signals control the number of electrons in the 
beam. The number of electrons in the beam is deter- 
minative of the intensity displayed. By controlling the 
red, green and blue beams for each pixel in this man- 
ner, varying colors and intensities can be produced 
on the display device. The beam(s) of electrons are 
directed towards a phosphor coated screen by a high 
positive voltage applied. The beams are directed to- 
ward a particular location (reflective of the x-y coor- 
dinate location of the pixel data) by a magnetic field 
produced by deflection coils. When the electrons of 
the beam hit the screen, the phosphor emits visible 
light, the intensity emitted dependent upon the num- 
ber of electrons which hit the screen. 

The process of the present invention is described 
generally with reference to Fig. 2. The object is descri- 
bed in MC space 105 or, alternately, world coordinate 
(WC) space. The texture map is defined in TC space 
120. The object is subsequently rendered and dis- 
played in the DC space 1 30. A parameterization proc- 
ess "P" is used to bind the object 1 1 0 to the PC space 
115. This process is performed once for an object and 
is view independent and texture independent. A map- 
ping is then performed between the TC space 120 
and PC space 115. This mapping is referred to herein 
as the x mapping. The t mapping is subsequently 
used to apply the texture map to the object 110 in the 
display coordinate space 130. 

Once the object 11 0 is transformed via a viewing 
transformation to DC space 1 30, the x mapping is util- 
ized to bring the corresponding texture map values to 
the DC space where it is applied to predetermined 
points of the object, such as the vertices of the object. 
Once the texture values from the texture map are ap- 
plied to the object in DC space, the texture values are 
interpolated to apply a texture value to each pixel of 
the object. A color composition process is then per- 
formed to combine the texture values with the colors 
of the object to generate a pixel image which is stored 
in the frame buffer and subsequently displayed. 

The process of the present invention introduces 
a new degree of freedom in the modification of tex- 
ture images as a result of the ability to control the 
process of texture mapping independently of the 
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primitives' geometry. In addition, this process pro- 
vides an implementation for a flexible, adaptive strat- 
egy for texture mapping wherein all types of primi- 
tives are supported. Furthermore, varying levels of 
quality of the actual textures utilized can be control- 
led. The process is described in further detail with re- 
spect to Figs. 3a, 3b and 3c. 

Referring to Figs. 3a and 3b, the system first re- 
ceives a definition of the object to be rendered in the 
modeling coordinates, step 200 (it should be noted 
that the MC space is also referred to as the object co- 
ordinate space). At step 21 0, a parameterization proc- 
ess is performed to construct a PC space associated 
with the object. An object, typically a surface, is de- 
fined in three dimensional space (e.g., MC space) 
and therfore coordinates (x,y,z) or alternately, 
(x,y,z,w) are used. A parameter space is typically a 
two dimensional space (s,t), defined in such a man- 
ner that each point on the object in MC space can be 
obtained by a mathematical or predefined function of 
s and t. This function maps the parameter space into 
MC space. By parameterizing the object, an indepen- 
dent representation of the object is achieved in PC 
space. The parameterization process can be thought 
of as binding process where, for example, with re- 
spect to polygon primitives, predetermined points (for 
example, the vertices of the object) on the polygon 
primitive are assigned or binded to values in the PC 
space. For complex surfaces, such as splines or 
NURBS, this step is not considered an additional step 
because the complex surfaces are defined in para- 
meter space. Parameterization is typically a complex 
process as it involves bending two dimensional para- 
meter values to a three dimensional object. There- 
fore, an advantage is achieved as the parameteriza- 
tion step is only performed once for any given object. 

At step 220, the x mapping of the PC space to the 
TC space is generated. This mapping is subsequently 
used to identify the texture coordinates correspond- 
ing to points of the object transformed into the DC 
space. This mapping also maintains the texture and 
parameter coordinates as separate parameters. 
Therefore, the parameter space can be regarded as 
a property of the primitive and the texture as a sepa- 
rate entity which is subsequently applied to the ob- 
ject. Furthermore, by modifying the t mapping, the 
displayed texture image can be easily controlled and 
modified without modifying the object or the texture 
map itself, x mapping is a lot simpler process than par- 
ameterization because same-dimensional (e.g., 2 di- 
mensional) spaces are involved, and therefore lends 
itself to re-execution for different texturing effects. In 
addition, by separating the parameter coordinate 
space and the texture coordinate space, very useful 
quality measures and dynamic texturing for splines 
can be implemented. 

A variety of known methods and functions can be 
used to generate the x mapping between the PC 



space and TC space. In a simple embodiment, para- 
meter and texture space can be configured to coin- 
cide. This embodiment corresponds to traditional tex- 
ture mapping in which a one-to-one or identity map is 

5 established. However, supporting non-identity maps 
is desirable to enable arbitrary warping effects to be 
performed on a given texture map to modify the dis- 
played texture. One method for defining the x map- 
ping is a direct specification in which u=U(s,t), 

10 v=V(s,t). This function can be defined to provide a va- 
riety of mappings including an identity function. It 
should be realized that the image of x mapping does 
not have to coincide necessarily with the entire tex- 
ture space. In that instance, portions of the texture 

15 map may not be utilized to generate the texture on the 
object 

Alternately, the x mapping is generated by select- 
ing a set of points in PC space, P=[(Sj,tj)] in PC space, 
and a corresponding set of interpolation values, 

20 T=[(U(Si,tj),V(Si,tj))], in TC space. For example, the set 
P can form a grid in PC space (i.e., P is a set of nm 
values [(Sj,tj)], where 1<=i=<n and 1<=j<=m) or a set 
of arbitrary values. Preferably, the only restriction on 
P is that it should contain all four corners, (smin,tmin), 

25 (smin,tmax), (smax,tmin), (smax,tmax), of the PC 
space. The interpolation process utilized can be a 
piece-wise linear interpolation or a spline of a higher 
order. For example, Fig. 5 shows a rectangular grid in 
PC space and corresponding interpolation values in 

30 TC space. 

Although the x mapping can be performed to map 
a texture coordinate of the texture map on each pixel 
of the object in the display space, this is a computa- 
tionally intensive operation, especially if the mapping 

35 is spline-based. Preferably, the x mapping, e.g., the 
corresponding texture coordinates, is determined for 
a subset of all pixels of the object image. For example, 
the subset of points can be a set of predetermined 
points, such as the vertices of the object. Although 

40 the mapping identifies only the corresponding texture 
coordinates for the subset of points, the texture coor- 
dinates for pixels between vertices are then deter- 
mined by interpolating between the subset of points. 
That is, instead of applying the x mapping at every pix- 

45 el in order to determine the texture coordinates, tex- 
ture coordinates for a subset of pixels can be deter- 
mined and the texture values for the remaining pixels 
are generated by interpolation. 

One interpolation method that can be utilized is 

so linear interpolation. In this approach, a triangulation 
of the set P is performed using available techniques 
such as the Voronoi diagrams. See (Franco Preparata 
and Michael Shamos, "Computational Geometry: An 
Introduction", Springer-Verlag 1988, pp. 198-216). 

55 Each point of the object in PC space, that is not with in 
the set of P, lies exactly within one triangle. Therefore, 
the barycentric coordinates of each point can be com- 
puted. The texture coordinates of the image of this 
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point is calculated using the barycentric coordinates 
in the TC space. This method is very general and 
works for arbitrary sets of P. Furthermore, spline in- 
terpolation on triangles can be used instead of linear 
interpolation. Regarding triangular spline interpola- 
tion, see, for example, G Farin, Curves and Surfaces 
for Geometric Design , (Academic Press 1991), pp. 
235-254. 

Alternately, bilinear interpolation on rectangles 
can be used. This approach assumes that the set P 
forms a regular grid. A bilinear interpolation is then 
used to determine the mapping for the intermediate 
points. Generally, the process of finding a rectangle 
in PC space containing the given point is simpler than 
finding the corresponding triangle. For example, P 
may be defined to form a regular grid. If P does not 
form a regular grid, the smallest grid containing P is 
constructed. This can be accomplished by drawing 
vertical and horizontal lines through each point in the 
set P. The intersecting points of these lines then form 
a regular grid P' containing P. The interpolation values 
for the points in P'-P can again be estimated using lin- 
ear interpolation. Furthermore, smooth spline interpo- 
lation using tensor-product interpolants on a regular 
grid can be performed using known techniques (see 
Farin, Curves and Surfaces for Geometric Design at 
pp. 221-233). Exemplary results of bilinear and 
smooth interpolation on rectangles are shown on 
Figs. 6a through 6e. Figs. 6a and 6b show interpola- 
tion grids in PC space and TC space respectively. 
Fig. 6c shows a checkered board texture map. Fig. 
6d shows a resulting image after applying bilinear in- 
terpolation mapping between PC and TC. Fig. 6e 
shows the same image after applying smooth interpo- 
lation mapping. 

Referring back to Figs. 3a and 3b, at step 230, 
the tessellation granularity is determined. This is an 
optional step which is particularly useful for the dy- 
namic tessellation of textured NURBS surfaces. It is 
preferred that at this point in the process the NURBS 
object is tessellated into facets. Although, the discus- 
sion below is in the context of NURBS, it is apparent 
to one skilled in the art that the techniques are readily 
applicable to other types of surfaces as well as other 
types of primitive objects. The concept of dynamic 
tessellation of NURBS curves and surfaces can 
therefore be expanded to include textured NURBS 
surfaces. In this method, the tessellation threshold 
criteria can be specified in DC space, MC space, PC 
space or TC space in order to achieve the tessellation 
granularity desired. Abi-Ezzi, et al, (see, for example, 
Abi-Ezzi, Shirman, "The Tessellation of Curved Sur- 
faces Under Highly Varying Transformations", Pro- 
ceedings Eurographics '91, 1991, pp. 385-397) de- 
scribes the concept of dynamic tessellation of 
NURBS curves and surfaces. A NURBS surface de- 
scribed by control points is displayed by breaking or 
tessellating the surface into planarfacets (such as tri- 



angles) defined by vertices and rendering the planar 
facets. The granularity of the tessellation is controlled 
by the application specified approximation criteria. 
For example, the application may require that the 
5 maximum size of a facet in DC or WC can not exceed 
a specified tolerance. Therefore, when a viewing or 
modeling transformation changes, the tessellation is 
dynamically adjusted to honor the approximation cri- 
teria. 

10 Typically, NURBS are tessellated in WC or LC 

space Abi-Ezzi, etal (see, for example, Abi-Ezzi, Shir- 
man, "The Tessellation of Curved Surfaces Under 
Highly Varying Transformations", Proceedings Euro- 
graphics '91, 1991, pp. 385-397). However, for pur- 

15 poses of explaining the tessellation process of texture 
NURBS, tessellation is assumed to occur in MC or 
WC space. Thus, an estimate of how a tolerance spe- 
cified in DC is mapped to MC is determined. Prefer- 
ably, this is determined by generation of a closed form 

20 expression for the minimum and maximum scale fac- 
tors of a perspective transformation in a bounded re- 
gion. (See, Abi-Ezzi, Shirman, "Scaling Behavior of 
Viewing Transformations", Computer Graphics and 
Applications, May 1993, pp. 48-54.) For textures, it is 

25 preferable to specify tolerance in texture coordinates 
so that the triangle size of the facets does not exceed 
a given tolerance in TC space. 

Fig. 4 visually illustrates various coordinate 
spaces and mappings between them. To estimate the 

30 scaling of a threshold from TC to PC, the bounds on 
the PC to TC (i.e., the t mapping) are used. Since the 
x mapping is typically piece-wise linear, the bounds 
are easily estimated. Once the bounds are estimated 
in PC space, the NURBS is tessellated at specified 

35 regular intervals in PC space (i.e., constant paramet- 
ric approximation criterion). Thus, thresholds can be 
specified in TC, PC, MC, or DC space and the surface 
can be dynamically tessellated to meet the thresh- 
olds. 

40 For example, given a maximum triangle sized in 

MC space, the number of segments needed to eval- 
uate a surface patch is: 

n _ l|S's|| _ ||S't|| 

s ~ H 1 ~ H 

a s,mc a t,mc 

45 where n s and n t are the required number of steps or 
segments in the s and t direction, respectively, d s>mc 
and d t>mc represent the thresholds of the NURBS in 
MC space, and ||S's|| and ||S't|| are the maximum der- 
ivative bounds of the surface patch in corresponding 

so directions (it is assumed here that the patch is para- 
meterized from 0 to 1) in MC space. For further infor- 
mation see, Abi-Ezzi, Shirman, "The Tessellation of 
Curved Surfaces Under Highly Varying Transforma- 
tions", Proceedings, Eurographics '91, pp. 385-397. 

55 If the maximum triangle size d is specified in DC 

space (i.e., pixels), the sizes d Sidc , d t>dc are mapped to 
MC space using the scaling behavior of a viewing 
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transformation and the norm of the modeling transfor- 
mation. Forf urther information regarding the determi- 
nation of threshold in MC space, see for example, Abi- 
Ezzi, Shirman, "Scaling Behavior of Viewing Transfor- 
mations", Computer Graphics and Applications, May 
1993. Once the mapping is performed, the number of 
segments n s , n t are determined as above: 
IIS'sll _ _ J|S1 
d t . 



n s = 



n t 



n s = 



J s,mc u t,mc 

If the thresholds are specified in PC space, the 
number of segments per patch is n s = 1/d SiPC and n t = 
1/d tfPC . However, if the maximum size d is specified in 
TC space (i.e., texels), the minimum size in PC is es- 
timated using the t mapping: 

s ' pc ~ INJI l ' pc " IKII 

where ||tJ| and ||tJ| are the maximum derivative bounds 
of the x mapping in s,t. The number of segments is 
then determined to be the inverses of d spc and d tpc : 

K[ nt = W ' 

d s ,tc ^tc 
It should be noted that the threshold specified in 
DC space is view dependent while the threshold spe- 
cified in TC space is not. In some instances, it is de- 
sirable to combine thresholds specified in TC space 
and thresholds specified in DC space or MC space. 
For example, it may be desirable to maintain a certain 
quality of texture for different views. Therefore, a sin- 
gle step size should be selected to satisfy both 
thresholds: 

n s = g(nN,nJ,thresh) 

n t = g(n t N ,n[, thresh) 
where n^ and n ^ are the number of steps computed 
from thresholds in DC or MC space, n^ and n{ are the 
number of steps computed in TC space, and thresh 
represents a predefined maximum value. For exam- 
ple, thresh could correspond to the number of steps 
obtained by specifying the threshold d Sfdc d tfdc to be 
equal to one pixel in DC space. The function g is typ- 
ically an averaging function. For example, could be 
defined as: 

min(max(n N n T ), thresh) 

Other combining techniques can also be used. 
For example, the step size determined according 
thresholds specified in TC and MC or DC can be aver- 
aged to generate a uniform step size for tessellation. 

The thresholds can also be used to determine the 
appropriate mip-map level. Once the number of steps 
n s , n t have been determined according to one of the 
above formulas, the thresholds in TC space can be 
determined as follows: 

d _ K| d _ W 

a s,tc - — - » a t,tc - — — 

n s n t 
The mip-map level can then be determined by, for 
example: 



log 



4f KtcA,tc) 



where 2 represents the mip-map level, f(d s>tc , d t|tc ) rep- 
resents some function of the thresholds, such as the 
product of the thresholds or the maximum of the prod- 

10 uct squared, and it is assumed that the TC space 
ranges from 0 to 1 in both u and v. 

Referring back to Figs. 3a and 3b at step 240, the 
object located in MC space is mapped to the display 
coordinate (DC) space. This step is accomplished us- 

15 ing a variety of known techniques. For example, the 
object in MC space is transformed to the world coor- 
dinate (WC) system by a modeling transformation. 
The World Coordinate system is the coordinate sys- 
tem in which the different portions of a graphic object 

20 to be rendered are assembled. Through a viewing 
transformation, the graphic object in the WC system 
is transformed to the DC system which corresponds 
to the screen space of the display. (For further infor- 
mation, see Foley, Van Dam, Feiner, Hughes, Com- 

25 puter Graphics Principles and Practice (Addison- 
Wesley Publishing Company, 1990), for example, pp. 
279-281). Alternately, the object can be transformed 
to lighting coordinate (LC) space through a rigid trans- 
formation and subsequently to the DC space through 

30 a sparse transformation (see, Abi-Ezzi, Wozny, "Fac- 
toring a Homogenous Transformation for a More Ef- 
ficient Graphics Pipeline", Computer Graphics, Vol. 
15, No. 2, pp. 249-258,1991). 

Once the object is mapped to DC space the tex- 

35 ture is applied to the object. This process referred to 
generally herein as interpolation and color composi- 
tion process, step 250 can be achieved a variety of 
ways. The process is explained with reference to Fig. 
3c. 

40 Referring to Figure 3c, at step 41 5, the colors at 

the vertices are determined. The corresponding PC 
coordinate values at the vertices are retrieved, step 
420. In one process, represented by steps 425, 430, 
435, 440 and 445, interpolation is performed on the 

45 vertices of the object to generate the individual pixels 
representative of the object (step 425). Well known 
techniques are used to generate the pixel image from 
predetermined parameters of the object (such as the 
vertices of the object) such as line scan algorithms 

so and the like. Alternately, for complex objects like 
NURBS, other known techniques are utilized, such as 
triangulation of the object surfaces and subsequently 
rendering the triangles generated using known scan 
line algorithms.The t mapping is used to determine 

55 the corresponding TC coordinates for each pixel (step 
430). The texture colors are then determined a variety 
of known techniques can be used, such as a direct 
lookup of texture values. Furthermore, techniques 
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such as mip-mapping and summed area tables can be 
used to perform the interpolation. See, for example, 
Williams, "Pyramidal Parametrics", Computer Graph- 
ics, Vol. 17, No. 3, July 1983 and "Crow, Summed 
Area Tables for Texture Mapping", Computer Graph- 
ics, Vol. 1 8, No. 3, pp. 207-21 1 , July 1 984. At step 440, 
interpolation of the object colors at the vertices is per- 
formed to determine the object colors at each pixel. A 
composition process is then performed, step 445 to 
compose or combine the object color and texture col- 
or to determine the final pixel colorfor the textured ob- 
ject. A variety of known color composition processes 
to combine two colors can be used. For example, the 
texture color can simply replace the object color and 
therefore the pixel color will be the texture color. Al- 
ternately, the pixel color can be the a combination of 
both the object color and texture color, such as simple 
averaging, weighted sum or averaging or the like. For 
further information, for example, see, Solaris< R > 
XGL™ 3.0.1 Programmer's Guide, SunSoft (1993, 
Sun Microsystems, Inc), pp. 387-389. 

Alternately, the following process may be used. 
This process is preferred when the granularity of tes- 
sellation is determined using thresholds specified in 
TC space. The TC coordinate values corresponding 
to the vertices of the object are first determined using 
the x mapping, step 450. Once the TC coordinate val- 
ues are determined, interpolation processes can be 
performed at different levels of information in order to 
determine the pixel colors of the textured object. In 
this process, represented by steps 455, 435, 440, 
445, the TC coordinate values are interpolated to de- 
termine the corresponding TC values at the vertices 
of the object. The texture colors are then extracted 
(step 435), the object colors interpolated (step 440) 
and the object color and texture color at each pixel are 
composed to generate the pixel color for the textured 
object (step 445). 

In another process, once the x mapping is used 
to compute the TC coordinate values at the vertices 
of the object (step 450), the texture color at each ver- 
tex is determined, step 460. At this point in the proc- 
ess, interpolation can be performed on the texture 
color values to generate texture color values for each 
pixel of the object (step 465) or a composition process 
can be performed at the vertices to combine the ob- 
ject color at each vertex with the corresponding tex- 
ture color (step 470). If the texture color interpolation 
process is performed (step 465), the object colors at 
the object vertices are then interpolated to generate 
a color value at each pixel of the object (step 440) and 
at each pixel, a composition process is performed to 
generate the colors of texture object (step 445). If the 
composition process is first performed (step 470), an 
interpolation of the composed colors at the vertices 
are interpolated, step 475, to generate the colors of 
the textured object. 

From the above discussion the process varia- 



tions are distinguished by the points in the processing 
at which interpolation of the vertex information is per- 
formed to generate per-pixel information. The choice 
of which variation to utilize will depend upon quality 
5 and performance considerations. In particular, the 
higher the quality, the poorer the performance. 
Therefore, interpolation of the PC values (e.g., steps 
415, 420, 425, 430, 435, 440, 445) produce the high- 
est quality image, but require the greatest amount of 
10 memory and processing overhead due to the number 
of per-pixel operations that are performed. Interpolat- 
ing the TC values (e.g., steps 41 5, 420, 450, 455,435, 
440, 445) produces the next best quality image with 
slightly higher performance. It follows that interpolat- 
es ing the texture color (e.g., steps 415, 420, 450, 460, 
465, 440, 445) is higher in performance and poorer in 
quality, followed by interpolation of the composed 
vertex colors (e.g., steps 415, 420, 450, 460, 470, 
475) which is the fastest process as the number of 
20 per-pixel operations is limited to the last step (step 
475) in which the composed colors are interpolated. 

Referring back to Fig. 3b, the resultant pixels 
generated with corresponding color and intensity val- 
ues are stored in the frame buffer, step 290. At step 
25 300, the pixels are actuated on the display at the lo- 
cation and intensity identified by the pixel data stored 
in frame buffer to generate on the display the textured 
object. 

One readily apparent advantage to the process is 

30 that the entire process does not need to be re-execut- 
ed if, for example, a new view of the object is to be 
rendered, step 31 0 . If a new view is to be rendered, 
the process branches to step 230 thereby eliminating 
the need to reperform the parameterization process 

35 (step 210) and the determination of the x mapping 
(step 220). Similarly, at step 320, a new texture map 
can be generated with respect to the same object. In 
this case, the x mapping at step 220 would be regen- 
erated to accommodate a new texture map and the 

40 process of parameterization of the object, step 21 0, 
does need not be re-executed. This allows the gener- 
ation of special visual effects, such as warping and 
the like, without affecting any texture and parameter- 
izations performed. 

45 The invention has been described in conjunction 

with the preferred embodiment. However, it is evident 
that numerous alternative modifications at variations 
of the uses will be apparent to those skilled in the art 
in light of the foregoing description. 

50 

Claims 

1. In a computer system comprising a central proc- 
55 essing unit (CPU), memory and input/output de- 

vices including a graphic display controller cou- 
pled to a graphic display device, a method for the 
rendering of textured objects on the graphic dis- 
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play device, each of said textured objects com- 
prising an object and a texture applied to the ob- 
ject, said objects defined by a plurality of vertices 
in Modeling Coordinate (MC) space, transformed 
to World Coordinate (WC) space and rendered as 
images in Device Coordinate (DC) space, each 
vertex having an associated color value, said 
graphic display device defined according to DC 
space, said texture defined by a texture map in 
Texture Coordinate (TC) space, said texture map 
identifying colors of the texture, said method 
comprising the steps of: 

constructing a Parameter Coord in ate (PC) 
space associated with the object; 

generating a x mapping of the PC space to 
the TC space; 

transforming the vertices of the object in 
MC space to the DC space; 

mapping the texture map to the object in 
DC space using the x mapping; 

composing the color values of the object 
with the mapped texture values to generate tex- 
tured object pixel data; 

storing each pixel data in a frame buffer, 
each pixel data being stored at a location in the 
frame buffer corresponding to the location of the 
pixel in the DC space; and 

said graphic display controller reading the 
pixel data stored in the frame buffer and gener- 
ating control signals to actuate the pixels at the 
location and color indicated by the pixel data; 

wherein textured objects are generated for 
display. 

2. The method as set forth in claim 1, wherein the 
step of constructing a Parameter Coordinate 
(PC) space associated with the object comprises 
the step of assigning the vertices of the object in 
MC space to values in PC space. 

3. The method as set forth in claim 1, wherein the 
step of generating a x mapping comprises the 
step of defining by direct specification wherein 
the (u, v) coordinates of the TC space are sped- 
fied with a corresponding (s,t) coordinate of the 
PC space, such that u = U(s,t) and v = V(s,t), 
where U(s,t) and V(s,t) represent functions of the 
(s,t) coordinates. 

4. The method as set forth in claim 1, wherein the 
step of generating a x mapping comprises the 
steps of: 

selecting a set of points in PC space, P = 
[(Sj, tj)], where (Sj, tj) represent the (s,t) coordin- 
ates in PC space for a set of points; 

determining a set of interpolation values 
TC space, T = [(U(Sj,tj), V(S|,tj))], where (U(Sj,tj), 
V(Sj,tj)) represents the (u,v) coordinates of the TC 



space to be interpolated; 

interpolating the (u,v) coordinates to be in- 
terpolated to generate the x mapping. 

5 5. The method as set forth in claim 4, wherein the 
step of interpolating comprises linear interpola- 
tion. 

6. The method as set forth in claim 4, wherein the 
10 step of interpolating comprises spline interpola- 
tion. 

7. The method as set forth in claim 1 , further com- 
prising the step of determining the tessellation 

15 granularity of the texture applied to the object. 

8. The method as set forth in claim 7, wherein the 
object comprises a NURBS, the tessellation cri- 
teria for the texture and the NURBS spedf ied in 

20 MC space and the number of steps in PC space 

to tessellate the texture and the object to obtain 
the vertices associated with the tessellated ob- 
ject is determined according to the following: 
n _ ||S's|| _ ||S't|| 

25 a s,mc a t,mc 

where n s and n t represent the required number of 
steps or segments in s and t directions, respec- 
tively, d s>mc and d t>mc , represent thresholds of the 
NURBS in MC space, and ||S's|| and ||S't|| are the 
30 maximum derivative bounds of the surface patch 

in the s and t directions in MC space. 

9. The method as set forth in claim 7, wherein the 
object comprises a NURBS, the tessellation 

35 threshold criteria is specified in TC space and the 

number of steps in PC space to tessellate the tex- 
ture and the object to obtain the vertices associ- 
ated with the tessellated object is determined ac- 
cording to the following: 

40 ^ kii kii 

d s ,tc d tft c 
where d S(tc and d t> t c represent thresholds in TC 
space and ||x s || and ||xj| are the maximum deriva- 
tive bounds of the x mapping in s,t. 

45 

10. The method as set forth in claim 7, wherein the 
object comprises a NURBS, the tessellation 
threshold criteria is specified in DC space and the 
number of steps in PC space to tessellate the ob- 

50 

ject and the step of determining the tessellation 
granularity comprises the steps of: 

mapping the threshold criteria d s>dc and 
d t>d c to the MC space to provide d s>mc and d t>mc us- 
ing the scaling behavior of a viewing transform for 
55 the object and the norm of a modeling transfor- 

mation; and 

determining the number of steps n s , n t ac- 
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d s ,tc ~ ~r~ » 



d - S 

a t,tc — 



n t 



where ||x s || and ||xj|| are the maximum derivative 
bounds of the x mapping in s,t. 

13. The method as set forth in claim 12, wherein the 
step of determining the mipmap level is per- 
formed according to: 



log 



4f ( d McA,*) 



where £ represents the mip-map level, f(d Sjtc , d Uc ) 
represents a function of the threshold values. 

14. The method as set forth in claim 1, wherein the 
step of transforming the vertices of the object in 
MC space to the DC space comprises the step of 
transforming the object via a modeling transfor- 



10 



cording to the following; 

n _ l|S's|| _ ||S't|| 

where ||S's|| and ||S't|| are the maximum derivative 
bounds of the surface patch in the s and t direc- 
tions in MC space. 

11. The method as set forth in claim 7, wherein the 
object comprises a NURBS, the tessellation 
threshold criteria is specified in MC or DC space 
and TC space and the number of steps in PC 
space to tessellate the object and the step of de- 
termining the tessellation granularity comprises 
the steps of: 

determining the number of steps from the 15 
threshold criteria specified in MC/DC space; 

determining the number of steps from the 
threshold criteria specified in TC space; 

generating a single size from both thresh- 
old criteria according to the following: 20 
n s = g(n^,nj,thresh) 
n t = g(n t N ,n[,thresh) 
where thresh represents a predefined maximum 
value, g represents an averaging function, and 
where n^ and n? are the number of steps comput- 
ed from thresholds in DC or MC space, n T s and 
ri[ are the number of steps computed in TC space. 

12. The method as set forth in claim 7, said method 30 
further comprising the step of, once the tessella- 
tion granularity n s , n t is determined, determining 

a mip-map level of texture from the correspond- 
ing threshold criteria in TC space, according to 
the following: 35 



25 



40 



45 



50 



55 



mation. 

15. The method as set forth in claim 1, wherein the 
steps of mapping the texture map to the object in 
DC space using the x mapping and composing 
the color values of the object with the mapped 
texture values to generate textured object pixel 
data comprises the steps of: 

determining the PC values of the vertices; 

interpolating PC values of the vertices to 
generate PC values of the pixels comprising the 
object; 

for each pixel, computing the correspond- 
ing TC values of the texture map using the x map- 
ping; 

for each pixel, determining the texture col- 
or for the corresponding TC values; interpolating 
the object colors at the vertices to determine the 
object colors at each pixel; and 

composing the object color and texture 
color at each pixel to generate the object pixel 
data. 

16. The method as set forth in claim 1, wherein the 
steps of mapping the texture map to the object in 
DC space using the x mapping and composing 
the color values of the object with the mapped 
texture values to generate textured object pixel 
data comprises the steps of: 

determining the PC values of the vertices; 

using the x mapping, computing TC values 
at the vertices; 

interpolating the TC values at the vertices 
to determine a TC value for each pixel of the ob- 
ject; 

for each pixel, determining the texture col- 
or for the corresponding TC values; 

interpolating the object colors at the vertic- 
es to determine the object colors at each pixel; 
and 

composing the object color and texture 
color at each pixel to generate the object pixel 
data. 

17. The method as set forth in claim 1, wherein the 
steps of mapping the texture map to the object in 
DC space using the x mapping and composing 
the color values of the object with the mapped 
texture values to generate textured object pixel 
data comprises the steps of: 

determining the PC values of the vertices; 

using the x mapping, computing TC values 
at the vertices; 

determining the texture color from the TC 
values at the vertices; 

interpolating the texture colors at the ver- 
tices to determine a texture color for each pixel of 
the object; 
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interpolating the object colors at the vertic- 
es to determine the object colors at each pixel; 
and 

composing the object color and texture 
color at each pixel to generate the object pixel 
data. 

18. The method as set forth in claim 1, wherein the 
steps of mapping the texture map to the object in 
DC space using the x mapping and composing 
the color values of the object with the mapped 
texture values to generate textured object pixel 
data comprises the steps of: 

determining the PC values of the vertices; 

using the x mapping, computing TC values 
at the vertices; 

determining the texture color from the TC 
values at the vertices; 

composing the object color and texture 
color at each vertex; 

interpolating the composed colors at the 
vertices to determine a color for each pixel of the 
object to generate the object pixel data. 

19. In a computer system comprising a central proc- 
essing unit (CPU), memory and input/output de- 
vices including a graphic display device, an appa- 
ratus for the rendering of textured objects on the 
graphic display device, each of said textured ob- 
jects comprising an object and a texture applied 
to the object, said objects defined by a plurality 
of vertices in Modeling Coordinate (MC) space, 
transformed to World Coordinate (WC) space 
and rendered as images in Device Coordinate 
(DC) space, each vertex having an associated 
color value, said graphic display device defined 
according to DC space, said texture defined by a 
texture map in Texture Coordinate (TC) space, 
said texture map identifying colors of the texture, 
said apparatus comprising: 

a Parameter Coordinate (PC) space asso- 
ciated with the object; 

a x mapping of the PC space to the TC 

space; 

a first transformation means for trans- 
forming the vertices of the object in MC space to 
the DC space; 

a mapping means for mapping the texture 
map to the object in DC space using the x map- 
ping; 

a color composition means for composing 
the color values of the object with the mapped 
texture values to generate textured object pixel 
data; 

a frame buffer for the storage of each pixel 
data wherein memory locations of the frame buf- 
fer correspond to locations in DC space; 

a graphic display controller coupled to the 



graphic display device and the frame buffer for 
reading the pixel data stored in the frame buffer 
and generating control signals to actuate the pix- 
els at the location and color indicated by the pixel 
5 data; 

wherein textured objects are generated for 
display. 

20. A computer system for the rendering of textured 
10 objects on the graphic display device, each of 

said textured objects comprising an object and a 
texture applied to the object, said objects defined 
by a plurality of vertices in Modeling Coordinate 
(MC) space, transformed to World Coordinate 
15 (WC) space and rendered as images in Device 

Coordinate (DC) space, each vertex having an 
associated color value, said graphic display de- 
vice defined according to DC space, said texture 
defined by a texture map in Texture Coordinate 
20 (TC) space, said texture map identifying colors of 

the texture, said system comprising: 

a host processor, said host processor 
comprising; 

means for determining a Parameter 
25 Coordinate (PC) space associated with the ob- 

ject; 

means for determining a x mapping 
of the PC space to the TC space; 

a first transformation means for 
30 transforming the vertices of the object in MC 

space to the DC space; 

a mapping means for mapping the 
texture map to the object in DC space using the 
x mapping; 

35 a graphics processing sub-system cou- 

pled to the host processor, said subsystem com- 
prising a color composition means for generating 
and composing the color values of the object with 
the mapped texture values to generate textured 

40 object pixel data; 

a frame buffer for the storage of each pixel 
data wherein memory locations of the frame buf- 
fer correspond to locations in DC space; 

a graphic display controller coupled to the 

45 graphic display device and the frame buffer for 

reading the pixel data stored in the frame buffer 
and generating control signals to actuate the pix- 
els at the location and color indicated by the pixel 
data; 

so wherein textured objects are generated for 

display. 
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